Collective effects induced by diversity in extended systems 
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We show that diversity, in the form of quenched noise, can have a constructive effect in the 
dynamics of extended systems. We first consider a bistable cj> 4 model composed by many coupled 
units and show that the global response to an external periodic forcing is enhanced under the 
presence of the right amount of diversity (measured as the dispersion in one of the parameters 
defining the model). As a second example, we consider a system of active-rotators and show that 
while they are at rest in the homogeneous case, the disorder introduced by the diversity suffices to 
' trigger the appearance of common firings or pulses. Both effects require very simple ingredients and 

^ ' we expect the results presented here to be of interest in similar models. 

g: 

+L ! I. INTRODUCTION 

> . 

In dynamical systems, the elimination of some internal degrees of freedom leads to an effective Langevin equation 
which contains so-called noise terms 1]. Those terms aim to represent in a probabilistic description our lack of 
knowledge about the exact microscopic dynamics. Typical effects of the noise terms are the erratic movement of 
the Brownian particle or the disappearance of the ferromagnetic phase at high enough temperatures. Given these 
and other similar examples, people were led to identify noise and disorder. However, one of the most astonishing 
developments of the last decades in the field of stochastic processes is that noise can have a constructive role. There 
are now several examples of that counterintuitive role of noise: phase transitions where a more ordered phase appears 
i when increasing the noise intensity 0]; stochastic resonance where the response to an external forcing improves in the 

presence of noise coherence resonance (also named as stochastic coherence Q) where an optimal periodicity 

t-H , in the output of the dynamical system appears for the right noise value, noise sustained patterns, structures and 
fronts HQ, etc. In these and other similar examples, the constructive role appears only in a limited window range of 
noise intensities. Too a large noise always recovers its disordering features. Studies have been performed in simple 
low-dimensional systems as well as in extended systems with many degrees of freedompjlini. 

In the latter case, a 

usual assumption is that the units composing the ensemble are identical in the sense that they all have the same values 
i for the relevant parameters characterizing their dynamical behavior. The only difference in their detailed dynamics 
\Q ' comes from the noise terms which take randomly different (uncorrelated) values for each of the units. 

When considering extended systems mostly in the biological sciences, the assumption of identical units is not 
an appropriate one, since those systems present a, sometimes large, diversity in the units. For example, cells of the 
same type vary in size and shape, as well as having different membrane conductivities, etc. Hence, it is not reasonable 
to assume that, even in the absence of noise, they will behave in the same way. Natural diversity (also known as 
"variability") has been considered in several different contexts: from the quenched noise terms representing impurities 



in magnetic systems |12j (where the critical temperature is lowered by the presence of the impurities) to the Kuramoto 

13,14] 
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model of coupled random oscillators with different natural frequencies |13t 1 1 ll (where synchronization is destroyed for 
a sufficiently large dispersion of frequencies). All these examples lead us again to identify diversity with disorder. 

However, as in the case of noise, some recent studies lead to the conclusion that diversity mig ht have a constructive 
role. Some previous work has shown the existence the phase transitions 0] and patterns 0] induced by quenched 
dichotomous noise. In this paper we will briefly comment on two recently found effects: resonance to an external 
forcing and common firing, both induced by diversity. In forced systems non-linear systems, we have proven [T^| that 
the global response of an extended system to an external forcing can be improved when the units of the system are 
not identical. In the case of global firing, we have shown that diversity can help the units of an extended system 
to pulse in synchrony. In both cases the basic mechanisms for the emergence of the collective behavior (described in 
detail in the following sections) require only very generic properties and both effects could occur in similar systems. 

The paper is organized as follows: in section^ we study the 4 model, a paradigmatic bistable model for phase 
transitions: in subsection lll Al we show the usual role of diversity, which leads to the disappearance of the ferromagnetic 
order. Next, in subsection lll HI we show that the global response of the model to a periodic forcing shows a maximum 
for a well defined value of the diversity. In section lTTTl we discuss a system of active rotators, a paradigmatic model for 
collective excitable behavior. First, in subsection IIII Al we first discuss the usual disordering role of diversity, while 
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in subsection IIII Bl we show that a collective behavior, in the form of synchronized pulses, appears for the right value 
of the diversity. The main conclusions of the paper are summarized in the final section HVI 

II. DIVERSITY-INDUCED RESONANCE IN THE (j> A MODEL 

The 4 model (also called Ginzburg-Landau or model A) is one of the basic models in equilibrium statistical 
mechanics and has been used to model many physical situations, although the simplest application is to describe 
the paramagnetic-ferromagnetic transition that occurs as a function of the temperature. In this model, a set of real 
variables Xi(t), i = 1, . . . , N are located in the sites of a regular <i-dimensional lattice. 

^ = axi-xf + —^2(x j -x i )+r) i . (1) 

Here Mi denotes the set of neighboring sites with which site i interacts, and Nj is the number of such neighboring 
sites. C is the coupling constant. An usual version of this model includes in Mi only the 2d nearest neighbors of 
i. In this paper, we will be considering the mean-field or all-to-all coupling version in which all sites interact with 
the same strength. Hence Mi contains all the lattice sites and Ni = N. The disorder r\i is usually considered to 
be a white noise of intensity proportional to the temperature. The model then displays a phase transition from an 
ordered (ferromagnetic) phase to a disordered (paramagnetic) phase at a critical temperature T C [I3- This is the 
generic behavior when a > and C > 0, the only cases considered in this paper. 

As we stated in the introduction, we are interested in analyzing the role of diversity in the units Xi. To this end, 
we neglect the thermal noise. Instead, the diversity appears as quenched noise, i.e. the values rji (with i = 1, . . . , N) 
do not depend on time, and are independently drawn from a probability distribution 3(77). At this moment we only 
assume a symmetric distribution g{rf) = g{—rf). The mean value of the distribution is (rji) = and the correlations 
are {rjirjj) = a r The standard deviation a is a measure of the diversity. 

A. The disordering role of diversity 

In this section we review the disordering effect that diversity has on the </> 4 model defined above. We use the 
all-to-all coupling where a full analytical understanding is possible. The all-to-all coupling assumption simplifies the 
problem and allows one to reduce it to a one variable. This is basically the Weiss mean-field treatment which is exact 
in the case of global coupling. Let us introduce the global variable m{t) as: 



™(*) = ^ X>(*)- ( 2 ) 

i=l 

The "magnetization" is defined as the time average of this global variable: 

m = (m(i)). (3) 
The coupling between the x\ variables appears only through this collective variable: 

^ = (a - C)xi - x\ + Cm + m. (4) 
This can be interpreted as a relaxational dynamics ^ = — with a potential: 

Vfa) = —^-Xi+ \x$-{Cm + TH)xi. (5) 

In the limit t — > 00 the variable x% will tend to one of the minima of V(xi). We restrict ourselves from now on to 
the case C > a for which the potential V(xi) has a single minimum, hence avoiding the possible metastable states 
that could occur otherwise. For fixed values of m and rji the variable X4 will tend to the unique solution of the cubic 
equation: 



+ (C — a)xi = Cm, + m. 



(6) 
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FIG. 1: Diversity induced resonance in the </> 4 model. In panel (a) we show the magnetization m as a function of the diversity 
a for the (f> 4 model with quenched disorder defined in Eqs.Q. The parameters are a = 1, C = 1 and the values of r\i are 
taken from a Gaussian distribution g(r\) of zero mean and variance a 2 . The line is the prediction of the mean- field theory and 
the symbols are the results of numerical simulations of the dynamical equations Q for system sizes N = 50, 10 2 ,10 3 ,10 4 (the 
transition sharpens as N increases). Panel (b) plots the spectral amplification factor fjasa function of diversity when the same 
system is forced by a periodic forcing of amplitude A = 0.2 and period £1 — 500. The line is the prediction of an adiabatic 
theory [l^l (not explained in the main text) and the symbols correspond to the numerical simulations in the case N = 10 3 . In 
the right panels, we show some representative trajectories Xi(t) (thin lines) and the average trajectory m(t) (thick line) in the 
case of a = 0.20 (panel c), <j = 0.54 (panel d) and a — 2.0 (panel e); the other parameters as in panel (b). Note the wide 
variations of m(i) in panel (d), corresponding to the optimal response to the external forcing. 



/ \l/3 

The explicit solution is Xi(r]i,m) = —-^-+Ui with the notation Uj = I an + ^/7 3 + cq J and 7 = (C — a)/3, 

on — (Cm + r]i)/2. To determine the value of the mean- field variable m we use the self-consistency relation (the 
subindex i is now dropped from the notation): 

where, assuming self-averaging, we have replaced the sum over variables by an average over the realizations of the 
diversity variables 77. Using the symmetry property of the distribution 17(77) the self-consistency relation can be 
expanded for small m: 

m = Fim + F 3 m 3 , (8) 

where F±, F3 > are coefficients that depend of a, C and a. As in the standard Weiss theory, this equation can have 
one or three solutions depending on the value of F\. If F\ > 1 then the only solution corresponds to the disordered 
phase m = 0. For Fi < 1 there are two additional solutions m = ±mo, which correspond to the ordered phase. A 
detailed analysis shows that for fixed a and C the ordered solution m ^ appears for a diversity a smaller than a 
critical value er c , while a diversity a > a c only admits the disordered solution m = 0. In this sense, diversity has a 
similar role to noise since a large diversity destroys the ordered state. The phase diagram is plotted in figure nP an el 
(a), in the case of a Gaussian distribution for g(rj) and a = 1, C = 1. In this case, the critical point can be computed 

J™J 3/2 = 0J573428.... 
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B. The constructive role of diversity 



We now consider the same model under the influence of a periodic forcing. In the case that the dynamics is driven 
by noise (instead of disorder) it is well known the existence of stochastic resonance, i.e. an optimal value of the noise 
intensity for which the response of the system reaches a maximum value .5]. We now demonstrate the existence of a 
similar effect under the presence of quenched noise. In the globally coupled case, we study the response to a periodic 
forcing of weak amplitude A and frequency f2: 



H axj —xl + — y^(ffj — Xj) + r)j + A sin(f2f). (9) 

3=1 

By a weak amplitude A we mean that its effect is such that the units make small oscillations around one of the 
equilibrium positions x — ±m . The global response is quantified by the average position of the units m(t) = 
fEi 1 *^) f° r which we now derive an evolution equation. By averaging the previous equation over the whole 
population, we obtain in the limit of large N: 

^ = am - 4; V xf + A sinffit). (10) 
dt N ^— ^ v ' 

i 

We now introduce Si = Xj — m and assume that the values of Si are evenly distributed around 0. This leads to: 

^ = m(a -3A)- to 3 + A sin(fti), (11) 
with A = -jj Sf. Hence, in the absence of forcing, m(t) follows a relaxational dynamics in an effective potential: 

V ! m ) = ^— -m 2 + -m\ (12) 

The potential barrier between the two minima is £°z|^3 , if the units are all identical, A = and the barrier 
takes its maximum value. Any source of diversity will lead to A > and the height of this barrier decreases for 
increasing diversity until it eventually disappears altogether if A = a/3. Therefore, it is possible that a forcing of 
weak amplitude A that is subthreshold in the absence of diversity, becomes suprathreshold when diversity increases. 
It is predicted then that the global response m(t) will increase suddenly when the diversity reaches a given value. For 
a large diversity, though, the potential V(m) becomes monostable and the system again executes oscillations around 
a single minimum, now located at m = 0. The existence of this resonance phenomenon can be clearly seen in figure 
IHb) where we plot the spectral amplification factor 77 = 4A~ 2 \{e int m(t))\ 2 as a function of the diversity a. 

In panels (c-e) of figure^we plot some representative trajectories for the individual units x$(t) as well as the mean 
m(t). In the case of small diversity, it can be seen that the units execute small oscillations around the same minimum 
following the external forcing (panel c). As the diversity increases over a critical value, the amplitude suddenly 
increases (panel d). Finally, for too large diversity, each unit now executes small oscillations, but each one oscillates 
around a different location and, hence, the amplitude of the oscillations of the global variable m(t) decreases (panel 
e), in agreement with the previous discussion. 



III. COMMON FIRING IN THE ACTIVE ROTATOR MODEL 

Dynamical systems on a circle have been a paradigm to study synchronization phenomena [l4|- This is due to 
their simplified dynamics that, in some cases, allows for analytical results. Nevertheless their simplicity, the results 
in those systems turn out to be broad applicability. In this section, we will focus on a system called active rotator. It 
exhibits cither an oscillatory or excitable behavior, depending on the system parameters. The model we will consider 
is a globally coupled set of active rotators [lj, |2(j whose dynamics is given by 

C N 

(j>i = co + Tji - sin fa + — 22 ■ sin {<f>j - ■ (13) 

3=1 

The global coupling of strength C is written such that it is 27r-periodic. The parameter ojj = uj + rji is the natural 
frequency of the j—th unit. For uncoupled units, if U3% < 1, the unit is excitable: there are two-fixed points (one stable 
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and another unstable). Any perturbation such that the system overcomes the unstable fixed point produces a firing 
of the unit: a large excursion until it arrives to the stable fixed point. On the other hand, if > 1, there are no fixed 
points and the unit is in the oscillatory regime. The values of the natural frequencies are drawn from a probability 
distribution function g(r]i), of mean (iji) = and correlations (t]ir]j) = <r 2 5ij. We consider the case uu < 1, such that 
when (7 = 0, all the systems are in the excitable regime and, in the absence of perturbations, they will all stay in 
perfect order at the stable equilibrium point. This order is degradated by the presence of diversity that makes each 
unit act differently from the others. We first study how the order decreases with diversity. 



A. The disordering role of diversity 

Order in the position of the units, can be measured by means of the Kuramoto order parameter. Let us define the 
(complex) variable p(i)e 1 *^ as the location of the center of mass of the rotators: 



1=1 



it) 



(14) 



The Kuramoto order parameter, defined as the time average of this variable, 

pe<* = (p(t)e**<«>) , (15) 

plays somehow the role of the magnetization m in the </> 4 -model. The argument ^ is the global phase of the system. 
The modulus p is a measure of the order in the position of the particles: it is equal to 1 if all the units have the same 
phase, and it is p = for a situation in which the units are uniformly distributed around the circle. However, in the 
excitable regime there are two different dynamical regimes that could give rise to a value p > 0: a dynamical one, in 
which the units fire pulses synchronously, and a static one, in which all the units are at rest in the stable fixed point. 

We now show how to compute p. A straightforward algebra leads to dynamical equations for the angles (pi in which 
the coupling between units appears only through the global variables, p 7 'J, as: 



= uJi — Rsm((f)i — a), 



(16) 



where i?= (1 + 2Cpcos* + c 2 p 2 ) 1/2 and tana^ 1 ^ i f r We now make the approximation of constant values for p 
and According to this equation, the rotators split in two categories: (i) those for who the natural frequency satisfies 
\u>i\ < R are in the excitable regime and the probability density function of the angle distribution is a delta function 
centered around the stable angle f((f>i) — 5(4>i — with 4>* = arcsin(w i )/i?; (ii) those for which |cjj| > R are in the 
oscillatory regime and the probability distribution is inversely proportional to the angular velocity f(4>i) oc |</>i| -1 . 
Computing the normalization constant we have: 



m) = 



2ix uJi—Rsin(( 

V^R 1 i 



-oc) 



2tt 



-uJi +R s\n{4>i — a) 



< R , 
> R, 

uji < —R. 



(17) 



This, in turn, allows to find the average value that appears in the definition of the Kuramoto order parameter as 
(e***) =F(rH,p,*), with 



F( m ,p^) = c- 



x < 



r: 2 



\u)i\ < R, 



(18) 



1 uj, < -R. 



Finally, the order parameter is found by solving the consistency equation (the subindex i is now dropped from the 
notation) : 



(19) 



FIG. 2: Common firing in the active-rotator model. In panel (a) we show the Kuramoto order parameter p as a function of 
the diversity a for the active-rotator model with quenched disorder defined in Eas ll.'-il The parameters are uj = 0.95, C — 4, 
N = 400 and the values of r)i are taken from a Gaussian distribution of zero mean and variance a 2 . The line is the mean-field 
prediction obtained by solving the self-consistent equation 1191 1 and the dots are the results of numerical simulations of the 
dynamical equations 113^ . Panel (b) plots the Shinomoto-Kuramoto order parameter £ as a function of diversity. A transition 
to a state in which the units pulse synchronously can be observed by the non-zero value of £ starting around a — 1.164. The 
line is the theoretical prediction Ea. l|22|l and the dots come from the numerical simulations. In the right panels, we show some 
representative trajectories 4>i{t) (thin lines) and the average phase \P(t) (thick line) in the case of a = 0.63 (panel c), a = 1.73 
(panel d) and a = 3 (panel e). Note the transition from the quiescent state (c) to a situation of common pulsing (d) and then 
to incoherent pulsing (e). 

This equation has to be solved numerically. In figure |2Ja) we plot p versus the diversity a in the case of a Gaussian 
distribution for g(j]) and the values uj — 0.95, C = 1 together with the results of numerical simulations of the dynamical 
equations 1131 It can be seen that the order parameter decreases monotonically as the diversity increases, although 
there is no sharp phase transition to a state of p = 0. This is the usual role of disorder. In the next subsection, we 
will show how diversity can induce a common firing of the active rotators. 

B. The constructive role of diversity 

In order to analyze the global behavior we derive evolution equations for the average variables p(t) and 'J'(i). We 
start by taking the time derivative of Eq. (|14f) and introducing the deviation with respect to the average angle behavior 
as Si(t) = tf>i(t) - By expanding e i5i = 1 + iS t + O(df), we are led to p{t) = O(Sf) and[l8|: 

* = - -sinf + O^ 2 ). (20) 
P 

This remarkable equation shows that the global phase \& follows the same dynamics than a single rotator but with 
an effective natural frequency u>/p. In the case of no diversity, a = 0, and uj < 1, all the rotators are in the rest state 
and p = 1. As soon as some disorder is introduced in the rotators, the order parameter p decreases such that when 
p = uj the global phase ^ becomes oscillatory. This is a true phase transition between a static phase and a dynamic 
phase in which the rotators pulse synchronously. As the value of p changes continuously at the transition point it can 
not be used to characterize the phases. To distinguish between the two phases, Shinomoto and Kuramoto introduced 
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another order parameter, £, in which the mean value of the center of mass is subtracted before taking the modulus |20|: 

C=(|p(t)e«*W-(p(t)e»*W)|). (21) 

If we approximate pit) by a constant value, it is ( w p(|e'*^ — (e 1 *'*- 1 )!), the average over time can be performed 
as an average over the distribution f(^>) of angles As in the case of a single rotator the distribution for u> < p 
is a delta- function centered around the stable equilibrium value 'J* = arcsin(w/p) , while for lo > p is is inversely 
proportional to the angular speed, f(^f) oc l^l^ 1 . This allows to perform the angular average with the final result: 

( uj < p, 

^ ( 22 ) 



where K{x) is the complete elliptic integral of the first kind. We plot in figure[2Ib) the order parameter £ as a function 
of the diversity a. Now it is clear the transition from the static state to a regime of common pulsing at a critical value 
a c w 1.164. In the right panels of figure [21 we plot some representative trajectories for the individual units <fii{t) as 
well as the mean angle ^{t). For low diversity, the units are at rest in their stable points (panel c). As the diversity 
a crosses the critical value tr c we can observe the synchronized firings (panel d). Finally, as the diversity increases 
further, the units start to fire in an unsynchronized manner (panel e). 



IV. CONCLUSIONS 



In this paper we have reported two effects in which some level of diversity induces a collective effect in dynamical 
systems. In the case of diversity induced resonance, the global response, as measured by the spectral amplification 
factor rj of the average variable m(t) shows a clear maximum as a function of the diversity ex. The mechanism of the 
resonance is particularly simple: in the homogeneous case the forcing is subthreshold for all units; as the diversity 
increases a fraction of the units are able to respond to the external forcing during half a period and another fraction 
of the units respond during the next half period; through the coupling terms, the sensitive units are able to pull the 
rest of the units in the direction of the forcing; for too large diversity, the favorable units can not overcome the effect 
of the adverse ones. 

In the active rotators system, we have shown the existence of a transition from the quiescent state where all units 
remain in the fixed stable point, to a regime of common pulsing induced by an increased in the diversity. Again, the 
mechanism is very simple: as the diversity increases, a fraction of the units have natural frequencies in the oscillatory 
regime; those units, through the coupling terms, pull the remaining ones into the oscillatory behavior. 

Those two effects show a constructive role of diversity and are the analog of the same effects induced by noise. It is 
to be stressed that it is the lack of perfect order that induces the collective effect. Our studies show that it is actually 
the disorder in the units that produce those collective effects and that it does not really matter whether the disorder 
is induced by noise, diversity or some other source, such as a random component in the network of connectivities or 
other sources. Since both phenomena require only generic ingredients, we expect that they should be present in the 
dynamics of suitable physical and biological systems and we hope that this work fosters experimental research in this 
direction. 
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